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WEAK ERROR EXPANSION OF THE IMPLICIT EULER SCHEME 



OMAR ABOURA 



Abstract. In this paper, we extend the Talay Tubaro theorem to the imphcit Euler 
scheme. 
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(N 

u , 

Oh. 1. Introduction 



Xt = x+ [ b{Xs)ds + I a{Xs)dWs, (1.1) 

Jo Jo 



Let (ri, J-", P) a probability space and T > a fixed time. W will be a Brownian motion 
in R with respect to his own filtration J^f We will consider the following stochastic 
differential equation 

rt rt 

Oh 

r~| ' where x € R, 6 and a are real functions defined on R. It is well know that, under Lipschitz 

j^ ■ conditions on b and a, this equation admits a unique strong solution. 

For various reasons, including mathematical finance or partial differential equations, 
the approximation of Ef{XT) is of importance. One way to do this is to use an Euler 
scheme and to study the speed of convergence. There is a vast literature on this subject 
^ I and one of the pioneering work is the paper of D. Talay and L. Tubaro [7]. 

r — ■ Let A'' S N* and h := T/N. Consider {tk)o<k<N the uniform subdivision of [0, T] 

O^ , defined by tk '■= kh. In their paper [7] the authors deal with the explicit Euler scheme 

(Xij.) ^^^^ defined as: Xt^ = x and for A; = 0, . . . , A^ — 1, 



g \ ^t,+, =Xt^+b {Xt,) h + a (XiJ AWk+i, (1.2) 

cn ; where AWk+i := Wt^^, - Wt^. They study the weak error Ef {Xt) - Ef {Xt 

'to 



Here, we will use the implicit Euler scheme defined as follow: Xfl = x and for k 



0,...,7V-1, 



^ . <. =K+^ «0 h + - iK) A^.+i. (1.3) 

Despite the fact that this implicit scheme cannot be implemented in most cases, it has 
been studied in [5j but, to the best of our knowledge, its weak error expansion has not 
been given. The main reason of this study is that we believe it would be a step in order 
to study a weak convergence error for SPDEs. So far in that framework only few cases 
have been studied in [2]-[l] for the stochastic heat or Schrodinger equation. 

Notations. Let ?i G N and v,w : [0, T] x R ^^ R be smooth functions. We will denote by 
d'^v{t,x) the n*'* derivative of v with respect to the space variable x, except for the second 
derivative denoted Av{t, x) as usual. Moreover, by an abuse of notation, for a function 
u : R ^- R and w : [0, T] x R ^> R, we will write {vw){t, x) := v{x)w{t, x). 

Given p € N, Cp will denote a constant that depends on p, T and the coefficients b and 
a, but does not depend on A^. As usual, Cp may change from line to line. 

For h small enough, we denote by S^ the functions defined on R by 

Shix):=l/{l-hb'{x)). (1.4) 

It is similar to the map used by Debussche in [3]. 
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2. The main result 
Let u the (classical) solution of the following pde, called the Kolmogorov equation: 
f ^n(t, x) + b{x)du{t, x) + ^a^{x)Au{t, x) = 0, 

The properties of u will be given in the next section. Let us mention that for b and a 
smooth enough, u is smooth too. We define the function ipi : [0, T] x R — ;■ R, where i 
stands for implicit, as follows for a smooth enough function u: 

^. := -bd (bdu) + -a^A ibdu) - -b^Au + -a^d^u - -bd (a^Au) - -a'^A (a^Au) . 

(2.2) 
We are now in position to state the main result of this paper. 

Theorem 2.1. Let b,a,f be C°° -functions with bounded derivatives. 

(i) The implicit Euler scheme ( fj.3|) is of weak order 1, that is, there exists a constant C , 

such that for h small enough \Ef {X^^ — Ef {Xt)\ < Ch. 

(a) The weak error can be expanted as 

Ef {X^) - Ef {Xt) = hE [ ip,{t, Xt)dt + 0(/i2). 

Jq 

We have not given the minimal hypothesis; indeed we want to focus on the ideas and not 
on the best set of assumptions. The proof of this theorem is quite long; it uses intensively 
the Kolmogorov equation ()2.ip . the ltd and Clark-Ocone formulas. It will be proved in 
the next section. We at first compare our result with that of Talay Tubaro. In their paper 
[7], the authors introduce the following function 

1 1 1 19^ 919 

^"^2 2 8 2dt^ dt 2 dt 

and prove the following result (see [7] page 489). 

Theorem 2.2. Let (^tj.)fc=o,...,Af denote the explicit Euler scheme defined by (|1.2p . Then 
weak error has the following expansion 

Ef{XT)-Ef{XT) = hE I Mt,Xt)dt + 0{h^). 

Jo 

Applying ^, bd and finally ^c^A to (|2.ip and summing these equations we have 

tU 



2a'^„. _ ufi(ua..\ ''uai^2A„\ ''^2A/ua„.\ '^^2a/2, 






+ 269— n + £T A— u = -bd (bdu) - -bd {a^Au) - -a^A {bdu) - -a^A (a^Au) 



So we can rewrite the function ^e as 

ije = -b'^Au + -ba'^d^u + -a^d\--bd (bdu) - -bd (a'^Au) - -a'^A (bdu) - -a'^A (a'^Au) 
^2 2 8 2^^4^^4^^8^^ 

For 6 = 0, we have V'e = V'j = ^a^d^u — gf^A (a^Au) as expected since in this case the 
explicit and the implicit Euler scheme coincide. We can notice that i/ji = il^e — b'^Au + 
^a^A{bdu) + bdibdu) - ^ba^d^u. 

3. Proof Theorem 12. II 

Here is a sketch of the proof: After proving some property of the scheme, we introduce 
a continuous interpolation of this scheme. Finally, after decomposing the weak error, we 
study a remainder term. 
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3.1. Some tools. 

Proposition 3.1 (Property of u). Let [Xs^] denote the stochastic flow, that is 

V / se[t,T] 

the solution of (jl.ip starting from x at time t and let u[t, x) = Ef ( Xrf^ J . Then u 

belongs to C°°'°°([0,T] x R) and satisfies the Kolmogorov equation (12.ip . Moreover, for 
any n,p G N, there exists constants C and k such that 



df^ 



dPu{t, x) 



<C{l + \x\ 



See for example [7] page 486 Lemma 2. 

Now we recall several results from Malliavin Calculus that will be used in the sequel. 
For a detailled introduction, we send the reader to D.Nualart's book [^. 

Proposition 3.2 (Clark-Ocone formula). Let t G [0, T] and F G L'^{Tt) D D^'"^; then we 
have for all s € [0, t] 



F = E{F\Fs) + I E {DrF\Fr) dWr- 

J s 



Lemma 3.3. Let F,G e D^'^. 

(i) LfF and DF are bounded, then FG € D^'^ and D{FG) = FDG + GDF. 

(ii) Let f £G^ with a bounded derivative; then f{F) £ D^'^ and Df{F) = f'{F)DF. 

(Hi) Let (s,t) G [0,r]2 such that s < t and let F E L»^'2 nL^ (j;). Then F {Wt - W^) G 
D^'^ and 

Dr [F {Wt - W,)] = DrF{Wt - Ws) + Fl{.<.<i}. 

(iv) Let {Hn,n > 1} be a sequence of random variables in D^'^ that converges to H in 
L^ (Q.) and such that sup^E I ||L'//„||^2fQ2^') ) < oo. Then H belongs to D^'^. 

For a proof of (iii), see [6] Lemma 1.3.4. Now we state some technical lemmas that will 
be useful in the sequel. The following discrete Gronwall lemma is classical. 

Lemma 3.4 (Gronwall's lemma). For any nonnegative sequences {ak)o<k<N o-iT-d {bk)o<k<N 

satisfying ak+i < {l+Ch)ak+bk+i, with C > 0. Then we have Ok < e^^'^"^''^ i oq + Yli=i ^i 

Lemma 3.5. Let L > 0; then for h* small enough (more precisely Lh* < 1) there exists 
r := iSlf^t > such that for all h G (0, h*) we have jrxh < 1 + T/i. 

Proof Let /i G (0, /i*); then we have 1 - L/i > 1 - Lh* > 0. Hence j^jj^ < jrxTF ^ ^^ ^° 
that Lh < Th{l - Lh), which yields 1 + Th- Lh- TLh^ = (1 + r/i)(l - Lh) > 1. This 
concludes the proof. D 

Lemma 3.6 (Generalization of Young's lemma). For an integer p > 1 and for e > 0, we 

have 



{a + b)'' <{l + e) 



a 



+ 



1 

1 + - 
e 



2P-1 



b 



2v 



Proof. We use an induction argument. The inequality is true for p = 1, that is (a + 6)^ < 
(1 + e)a^ + (l + i) 6^. Now, suppose that it is true until p and will prove it for p + 1; 
indeed the induction hypothesis yields 

2 



(a + b)'''^' < 



<(l + e)|(l + e 



a" + ( 1 + - 

2P-1|2 I 2P|2 



2P-1 



,2P 



+ 



e 



1 

1 + - 
e 



2P-1 



.2^2 
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This concludes the proof. D 

3.2. Property of the implicit Euler scheme. 

Lemma 3.7 (Existence of the scheme). For small h, the implicit Euler scheme ()1.3p is 
well defined. Moreover, for all k = 0, . . . ,N, we have X^^ € L^ {J~tk)- 

We will denote by Nq the smallest integer such that the scheme is well defined. 

Proof. For k = 0, we have X^ = x £ L'^{Tt^). Suppose that for all j = 0,...,k, 
XP is well defined and belongs to L^ (-^i )i ^^ prove this for j = k + 1. We define 
ik+i '■= ^ti + <7 {-^ti) ^^fc+i- ^y independence of AVF^+i and Tt^. and the linear growth 
of (T, we have that ik+i G L"^ {^)- Let F^+i : L^ (0) -^ L^ (il) be defined by 

Fk+i{X):=ik+i + KX)K (3.1) 

for ah X e L'^ (0). Using the Lipschitz property of b we have E \Fk+i{X) — Fk+i{Y)\'^ < 
|||6'||oo/i| i? |X — y| . So by the fixed point theorem, if ||6'||oo^ < 1 there exist an unique 
element of L'^{Q,), noted X^^ , such that X^^ = F^+i \X{^ 1. The measurability of 
X[f with respect to J't^+i is obvious. D 

Lemma 3.8 (Malliavin derivability) . Let h > small enough; then for all k = 0, . . . ,N , 
we have X^^ € D^''^ . Moreover, for all t € [tk,tk+i), we have DtX^^^^ = St (^t^+i) cr {X^^) , 
where Sh is defined by ()1.4p . 

Proof. It is true for k = 0, since Xq^ = x. Now suppose that for all j = l,...,k, 
Xi^ S D^'^ and prove that Xlf S D^'^. First, we define the following sequence in L^ (Q): 
xt+iiO) = and for i > 0, X^^(i + 1) = Fk+i (X^i(i)) where Fk+i is defined by ^^. 
Using the Lipschitz property of E^+i, since X^ is a fixed point of Ffc+i, we have 

i+i 



E 



^/L-^^i(^ + i) 



< Wlb'W^hl E 



^tk+i -Xk+i{i) 



<{\\\b'\Uhr\ E 






So X^,-^^{i) converge to X^f in L (J7) if ||6'||oo/i < 1- Using the induction hypothe- 
sis, the assumptions on a and Lemma 13.31 (ii) and (iii), we deduce that ^k+i = ^tl + 
a (^j^) AVFfc+i belongs to D^'^. Finally, since b is Lipschitz, we deduce by induction that 
for aU i > Xf (i) € L>^'^ Moreover we have DXJ^{i + 1) = I?6+i + hb'{X^ {i))DX^ {i) 
and DX^i(O) = 0, so that 

pXi^(i + l)||i.(o^y)<2||Z)efc+i|li2(o,T) + 2/i'l|b'llLll^^ir«lli2(o,r)- 
An induction argument yields for i>l and 2/i^||6'||^ < 1, 

ll^^tfcl«JllL2(0,T) ^ ^ 1 _nu2\\ui\\2 ' 
^ ^'^ II" lloo 

Finally, we have supj ||DX^(i)|| < co. Lemma [3l3] (iv) proves that X^^ € D^'^. 
Finally, let t € [tk,tk+i)', applying the Malliavin derivative D to (|1.3p and using Lemma 
13.31 we have 

A<,=/.6'«jA<,+a(X,^); 

which concludes the proof. D 

The following result gives a bound of p moments of the implicit scheme. 



WEAK ERROR EXPANSION OF THE IMPLICIT EULER SCHEME 5 

Lemma 3.9. Fix p > 1; then for Nq large enough, there exists a constant C{p) > such 
that 



sup max ElXf^r <C(p). 



(3.2) 



Proof. Holder's inequality shows that it suffices to consider moments which are power of 
2, that is to check supjv>Ar„ niaxfc=o,...,Af E |X/^ | < Cp, for every integer p > 1. Using the 
generalized Young Lemma 13.61 the independence between AW^+i and Tt^ , and the fact 
that for all j € N, E [AWk+i) '' = 0, we have for h G (0, /i*) and some constant Cp 
depending on h* 



E 



X 



N 
tfc+i 



2v 



<{l + hr~'E\X?^+a{x![)AW,^,\ 



2P 



+ I^ + X 



2P-1 



h^'E 



N 



b XI' 
\ ffc+1 



\2P 



<(i + cph)E \x,^f + (1 + Cph) Y. (2 O^ (Ki''"'' I" w) ro ^ i^^^+ii'' 



+ Cr,h 1 + E 



X 



N 
tfc+i 



2P 



Using the identity E \AWk+i\ "' = C{2j)h^ and the linear growth of a we deduce for h < I 



E 



2P 



N\^" 



^N 



Xil^ < (1 + C,/i) E \Xil I + Cp/i + Cp/ii? Xil^ 



2P 



+ (i + Cph)Cph Y. e(K\ (i + K 



^7V|2j 



j=l,...,2P-i 



Using the inequality: a'^^ ^-^ < a^'' + 1 valid for any a > 0, we get for some constant 



Cp> and h <1 



E 



2P 



N 



,2P 



Xil^ < (1 + Cph) E \Xil I +Cph + CphE Xil^ 



tfe+i 



2P 



Provided that h is small enough, the Gronwall Lemma 13.41 and Lemma 13.51 conclude the 
proof. D 

3.3. Some martingales and related process: (3^' ,Zf' ,7^' and r]^' . Let k € 
{0, ...,A^ — 1} be fixed; in the sequel, we will use the following processes defined for 

te [tk,tk+i] 



k,N 



F,), zf'^:=i^ A6 <, 



J't), 



(3.3) 



ir :=^ {XO + {t- t,) z^, vr ■■= - {XO E A {S,b') (Xll^^ 



Tt 



The following lemma describes the time evolution of these processes. 



Lemma 3.10. For all k = 0, . . . ,N — 1, and for t G [tk,tk^i], we have the following 
relation 

ink.N k,N ijTT 1 k.N k,N -.TTT , k,N k,N -,, , k,N /, , \ jrir 

dp^ = Z-i- dWt, dz^' = "Ht dWt, d'-f^ = z^ dt + r]^' [t — tkjdWt, 



dr/f '^ = \a {X[l) \' E A {Sib") ^^^^ | J", dW, 
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Proof. Let A; = 0, . . . , A^ — 1 and let t G [tk, ifc+i]. Lemmas 13.31 (ii), 13.71 and 13.81 and the 
bounds of ||6"||oo imply that b (^t^_^,) € L^ (Tt^^,) D D^'"^ and 

(3.4) 



^^b «0 = b' «,) Dai:,, = iS.b') {Xi:^;) a (Xll) 



:)k,N 



So the Clark-Ocone formula in Proposition 13.21 yields /3^'^^ = b [Xj.'^ ) — /^''^^ Zg'^" dW^ 



k,N 



and hence (i/3, 



k,N 



k,N 



z^ ' dWt; where zi 



k,N 



E { D..b {Xi:^^]\Ts]; using ^ 



.k,N 



a {Xll) E US,b') (XH^^ 



-F, 



(3.5) 



that {Shb') ( X^ j G D^'^ and using the Clark-Ocone formula we deduce that for s G 



So taking conditionnal expectation with respect to Tt, we have (|3.5p . Since b" is bounded 
and b' Lipschitz we have that for h small enough, Shb' = jr^ ^ ^b- ^° ^^ ^^'^ conclude 

') (x^ ^ ^ "^'2 
[*fc,*fc+i), 

and hence 

6' 



ife+l 



EiDu 



Skb' ix^,,. 



Tu dWu, 



dz 



k,N 



a (X,^) E ( D. 



U l^tfc + l 



T, 1 diy, = ^'I'^'dw,. 



k,N 



i-hb 

The differential of 7^'" is a consequence of the previous result and Ito's formula. Fi 
nally, since Sub' G Cl and {Shb')' = S^b", Lemma ESI implies that Dt{Shb') (x^^^^ 

a{Xi:){Slb")[x,^^^,)andthen 

,r = |.«)fi^((536")«0l-^*)- 
Applying once more the Clark-Ocone formula in Proposition 13.21 we deduce 

E (slb" «0 1-^0 = (Sib") (<0 - r^ E i^siSlb") (XH) \T^ dW.. 



(3.6) 



Multiplying this by \a [X^l) and using (j3.6p . we conclude the proof. 

The next lemma provides uniform moment estimates of the above processes. 



D 



Lemma 3.11. Let p G N; then for Nq large enough there exists a constant Cp such that 
for N > No, 



max 



sup E 



k=0,...,N~lt,<t<t,+, 



^k,N 


P 
+ 


k,N 
^t 


P 
+ 


k,N 
It 


P 
+ 


k,N 

Vt 



<Cr, 



Proof Using Jensen's inequality, the Lipschitz property of b and Lemma 13.91 we have 



E 



A 



k,N 



< E 



6(Xf 



<Cp(l + E 






<Cp. 



The identity (j3.5p . Jensen's inequality, the growth property of a and the upper estimate 
b'/{l — Kb') > C for small h, Schwarz's inequality and Lemma 13.91 vield 



E 



k,N 



<E 



a{X-)iShb')iX-^, 



<Cp. 



fc,7V 



Using the definition of 7^ ' in ()3.3p and the previous upper estimates we deduce 



E 



k,N 
It 



<CpE\o{Xf^^ ^Cph^E 



k,N 



<c„ 
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Finally (13. 6p . the Jensen inequality, the growth condition on a, the upper bounds of b' 
and b" , Lemma 13.91 and Schwarz's inequality yield 



E 



Vt 



k,N 



< E 



kfx 



7VN|2P 
tk)\ 



[Sib") 



N 






<c„ 



This concludes the proof. 



D 



3.4. Continuous interpolation. As usual we need to introduce a continuous process 
that interpolates the implicit Euler scheme (jl.3p . With an abuse of notation, let {X^^) r ^, 

be the process defined as follow: Xq = xq and for A; = 0, . . . , A^ — 1 and tf^ < t < t^+i 



X 



N 



X 



N 



E b X, 



^N 



Tt){t-tk) + a{xn{Wt-Wt 



'tk, 



(3.7) 



This process satisfies the following 

Lemma 3.12. The process (X/^) r „, is continuous Tt-adapted and is an interpolation 



N 



of the scheme ()1.3p . Moreover, for /c € {0, . . . , A^ — 1} and t G [ifc,ifc+i] we have dX, 
/3j ' dt + 7^ ' dWt, where the process {f3^' ) and (7^' ) are defined by (|3.3p . 

Remark 3.13. (1) If 6 = 0, (|3.7p corresponds to the classical interpolation given by Talay 
Tubaro [7], since the explicit and implicit Euler scheme are the same. 
(2) If b is linear, this continuous process differs from that used by Debussche in [3]. Indeed, 
the finite dimensional analog of the interpolation correponding to the process dXt = 
-pXtdt + a (At) dWt, is defined by 



xF 



xZ + 



-/3A, 



TV 



^ds + 



* - iK) 



t,. l + h/3 



<t, 1 + ^/3 

for t G [tk^tk+i] (see [3] page 96 equation (3.2)). In this particular case, our interpolation 
is given by 

ft ft 

X^ = X^^+ j^ E{-liXF^jFs)ds + j^ {a{xF^) + {s-tk)E{-DsPXF^^\Fs)}dWs. 

Proof of Lemma \3.12l The fact that (X^) is an (J-t)-adapted process which interpolates 
the scheme (jl.Sp is a consequence of (j3.7p . The continuity is a consequence of the fact 
that the map (t 1— )■ E {X\J^t)) has a continuous modification. So, applying Ito's formula 
and Lemma [3. 101 we obtain (i(/3^ ' (t — t^)) = {t — t^) z^ ' dWt + /3^ ' dt, and hence 

dAf = P^'^'dt + (a (Xi^) + (t - t,) zf '^) dm. 

This concludes the proof. D 



We next give moment estimates of the interpolation process A/^. 

Lemma 3.14. Let p > 1 and h* > be small enough. There exits a constant Cp > 
depending on h* such that 

sup sup i?|A/^| < Cp. 

N>Note[0,T] 

Proof. Using Lemma [331 Jensen's inequality and the independence of Wt — Wt^ and X^, 

we have for t G [tk,tk+i]: 

Elxi'l^KCpElxl'f + CpE 

b(x 



N 



E b Xtl\\T, 



k+l 



It-tkf + CpElaiXf'Jl'lWt 



<Cp + CphPE 



N 
tfc+i 



+ E a(X, 



E\Wt 



WtA 



Using the growth condition on b and cr, moments of the normal law and Lemma 
deduce the result. 



WtJ 



we 

D 
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The following is a straightforward consequence of Lemmas 13.111 and 13.141 

Corollary 3.15. Let v : [0,T] x R — >• R &e a function with polynomial growth, and let 
ni,...,nQ non negative integers. Then there exists a constant C independent of h* such 
that for r £ [tfc, tfc_|_i] and h G (0, h*) 



E 



fir 



k,N 



"1 



Z,. 



k,N 



"2 



7^^ 



"3 



k,N 
Vr 



nn 



r-t,r|t;(r,Xf)pn<C7. 



3.5. Local decomposition. Now we return to the proof of the main theorem. Let u be 
the solution to the Kolmogorov equation (|2.ip . Using (12. Ih , we decompose the weak error 

into a sum of local errors. Let 5^ := Eu ( t^+i, X/^ ^ j — Eu (t^, X/^) ; we deduce 



N-l 



Ef {X^) - Ef {Xt) = Eu (T, X^) - Eu (0, x) = ^ <5, 
We introduce, for tk < t < tk+i, 



■N 
k ■ 



(3.8) 



fc=0 



rNl 



ok,N 



^N 



N\ 



tN , 



Ii'{t):=E if3r-b{Xndu{t,Xn , J^^t):=E 



k,N 
It 



.ATn 



^^(XD An(t,X, 



N\ 



Since u G C^'^, using Ito's formula, Lemma 13.111 and the Kolmogorov equation ()2.ip at 
the point (t, X^^ , we obtain 



6, =Ej^^ |-n + A du + - 



k,N 

It 



Au \ {t, X^) dt 



--E 



■'^' ^f(t) + ij,^(t)^dt. 



Now for A; = 0, . . . , A^ — 1, we introduce the following quantities for s G [tfc, t^+i] 



aN/ 



d 



^(,) := (pdu) (s,Xf ) +/3^^a(65t.) (s,Xf ) 



ds 



+ 



(3.9) 
(3.10) 

(3.11) 



7.^'^ 



d 



A {bdu) (s, Xf ) - /3^^^9n (s, Xf ) 



9s 



/5, 



fc.Ar 



I ^k,N„,k,N \ A„, /„ vN) 

+ ^s Is I Au(s,A^ 



}_ok,N 



j^^)- 



7.^'^ 



+ 



2 d_ 
'Fs 



.M,N 



An(s,Xf)+/3, 



jfc.Af 



..k,N 



d^u{s,X'^ 



k,N 



'd'u{s,X^), 



(3.12) 



7^ 



d\{s,X^)+2^^'^z','^Au{s,Xf) 



ri's^'' 



7.^'^ 



+ |s - tfc 

^ (^T^An) (s,Xf) -/3,^'^a(a2An) (s,Xf 



2 



f) 



7; 



fe,Ar 



A(cT2An)(s,Xf) 



Au{s,X^)+2{s-tk) 

Qg ((T-ZXnj ^s, A - j - /:^-- c/ ^a' Anj ^s, X^ ) - - 

The next two lemmas explain that, up to some sign, I^ (resp. J^^) can be viewed as an 
antiderivative of i^ (resp. j^). 

Lemma 3.16. For all k = 0, . . . , N-l, wehaveT^{t) = E f^'^+U^ {s)ds fort G [tfc,tfc+i]- 



Proof. If we denote hy A := E 



prdu{t,xn 



E 



HK,. du[t,^„X- 



and by 



B := E 



b (Xi" du {tk+i,Xi[^^ ) -E[b {Xi") du {t, Xi")] we can write Xf (t) = A+B. 
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Lemma 13.111 enables us to apply Ito's formula: Let v : [0, T] x R ^ R be of class C^'^; 
Ito's formula yields 



d.(t,Xf)=^|. + /3,^'^9. + l 



k,N 
It 



Av \ [t, Xf ) dt + Jt'dv {t, Xf ) dWt. (3.13) 



Using this equation with Lemma 13.101 we have for v £ C 



1,2 



d 



1 



13^'^ V (r, X,^) = /3^^f ^ + /3^^ dv + ±A 



}k,N 



dr 



7^^ 



+ 



{/3^^^^5.+z^^.}(r,x,^) 



dWr 



Av + z'^'^j^'^dv \ (r, X^) dr 

(3.14) 



The function Au has polynomial growth; hence corollary 13.151 implies that 

E //'=+! hs'^-fs'^Au + Zs '^anj {s, X^) dWs = 0. Using equation (l3l^ with i; = du, in- 



fc.Af 



tegrating between t and tfc+i, using the fact that /3. ' = b Xl and taking expectation 



we obtain 



A = -E 



•fc+i 



/3. 



5 



'='^"9n + 



(9s 



A 



fc.Af 



' An + ^/3^^ 



7^^ 



(3.15) 



Similarly, Corollary [3l5] implies that £'//'=+^ -fs'^d{bdu) (s,Xf ) dW, = 0. Using (|3l^ 
with t; = bdu, integrating between t and t^+i and taking expectation yields 



B=E r^' l-^^ (bdu) + /3,^'^a (6atx) + i 



7.^''^ 



A (Wn) \ {s, Xf ) ds. 



The stochastic integral is centered by Corollary 13.151 This identity combined with (J3.15P 
concludes the proof. D 

Lemma 3.17. For all k = 0, . . . ,N -1, we have J^ {t) = E J^ j^is)ds for t € [tfc,tfc+i]. 
Proof. Using ()3.3p we clearly deduce that J^ {t) = C + D where 



C ■.=E 



a{x!l) + {t-t,)zr Au{t,X,^) 



E[a^X{l) An {t,,X^J] 



D :=E [a' «) A^ {t,,X{'J] - E [a' (xf ) A^ (i,Xf )] . 

We at first rewrite the term D: using (j3.13p with v = a'^Au, integrating between tk and t 
and taking expectation, we obtain: 



D = -E f l^^ {a^Au) + I3':'''d {a^Au) + ^ 



.,k,N 



A(a'Au) )' (s,X^)ds, 



since a'^Au has polynomial growth which implies that the stochastic integral is centered 
using Corollary 13.151 Ito's formula and Lemma [3.101 yield for r G [tk,tk+i] 



d 



7^'^ 



27^^z^^ + 



V^-'"" 



r - tk\' dr + 2j^^''r,^^''{r - tk)dWr. (3.16) 
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Using this equation and (j3.13p . we have for v of class C ' and r G [ifc,tfc-|_i] 



d 



7^^ 



V [r. 



xn 



7^^ 



or 



7^^ 



2 1 

dv + - 



7^^ 



+27,^'^z^^^ + 



„fc,Af 



\r-tk\ v + 2 



.AN 
Ir 



Av 

2 



(3.17) 



(^^•^ydv + 27^^r?^^(r - t,)v\ (r, Xf ) dl^, 



+ 



Using equation (j3.17p with v = Au, integrating between tk and t, using the identity 



k,N 



Tt. 



a {X^^ and taking expectation, we deduce 



C = E 



..k,N 



"^Au + P^'^ 

OS 



.M,N 



2 c. 1 



7.^'^ 



d\ 



+27^- Zg' An + |s — ifcl 



fc,7V 



An + 2(s-tfc) 



7. 



fc,7V 



r/^^53nWs,Xf)ds. 



Indeed, once more Corollary 13. 151 and the polynomial growth of dAu and Au implies that 
the corresponding stochastic integral is centered. This concludes the proof. D 

Plugging the results of Lemmas 13.161 and 13.171 into (|3.10p we obtain 

Ef (X^) - Ef (Xt) = Y. E j'y^' l^j^' i^{s)ds + \ [jk{s)ds^ dt. (3.18) 

Note: Thanks to Corollary 13.151 and the assumptions growth or boundness on the coeffi- 
cients, all the stochastic integrals appearing in the next section, are centered. 

3.6. Upper estimate of I^{t). We next upper estimate the difference </'i(s) — (j)i{tk+i), 
where (pi is one of the seven terms in the right hand side of (j3.1ip 

3.6.1. The term (j)i{s) = -^ (bdu) [s,X^). Using p.l3p with v = -^{bdu), integrating 
from s to tfc+i and taking expected value we deduce 



Eg-^{bdu) (s,Xf) =E^^{bdu) {tk+i,X[l^^)+R,{s), 



where 
Ri{s) :-- 



-E 






7^^ 



9 ^ 

A — {bdu)\ {r,X^)dr. 



Futhermore, Lemmas 13.141 and 13.111 and the polynomial growth of the functions involved 
imply that |^i(s)| < Ch. 

3.6.2. The term 4>2{s) = Ps' d {bdu) (s,X^). Using (j3.14p with v = d{bdu), integrating 
between s and t^+i and taking expectation we obtain 



E 



f3^'^d{bdu){s,X^) 



E 



b[X^\d{bdu)[tk+,,X,^\ +R2{s), 



where 



R2{s) :-- 



-E 



OS 2 

+ j^'^ z^'^ Aibdu)] {r,X^)dr. 



7^^ 



d^bdu)} 



The polynomial growth of the functions and Lemmas 13.141 and 13.111 implv that |i?2('5)| ^ 
Ch. 



3.6.3. The term (j)s{s) = ^ 
+2j^'^ z^'^ A{bdu) + 
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kM 



7s 



ir 



2 d_ 

dt 



A{bdu){s,X^). Let 

2 



A{bdu) + /?, 



k,N 
r 



% 



k,N 



d^{bdu) + 



1 



% 



k,N 



d^{bdu) 



k,N 



jr-ifcpA(6an) + 2 



7^^ 



'i]^;'''{r-tk)d^{bdu)\{r,X^)dr. 



Using ()3.17p with v = ^A{bdu), integrating between s and tk+i, and taking expectation 
give us 



1 

-E 
2 



k,N 



2 



k,N 



rr- A{bdu){s,x^) 

with |i?3(s)| < Ch. 

3.6.4. The term ^s) = Ps'^ -§^du {s,X^). Let 



Aibdu){tk+i,Xll^^ 



+ R3is), 



RAs) 



E 



tfc+i 



d' 



k,N 



2„a 



1 



l3^''^—.du+ 13^^'^ d—du + -f3, 



>k,N 



ds"^ 



ds 



% 



k,N 



2 d 
A—du 

OS 



d 



+ 7;'^<'^9^au [r,X^)dr. 



ds 



Using ()3.14p for v = -Qzdu and integrating between s and t^+ii we obtain 



-E 



P^'^'lduis^X^) 



dt 



-E 



'•^t.)^ 



N 



duitk+uXll^ 



+ i?4(s), 



with \Ri{s)\ <Ch. 



3.6.5. The term (^5(s) = /3s"' Au(^s,X^). Using Ito's formula and Lemma [3.101 we 
have 



d 



/3; 



k,N 



k,N 



dr + 2p''/^z'^y^dWr. 



Using this equation, ()3.13p and Ito's formula we obtain 

2 



d 



/3, 



+ 



k,N 
r 



An (r, X 



A 



k,N 
r 



l^-C^I'^'-n 



/s; 



fc.AT 



7^^ 



'd\ 



2 



where dMr = i 2/3,- ' Zr ' Au + 



A 



k,N 



'r,X^)dr + dMr, 

k,N 



grable martingale. Let 



7r-' d^u > (r, X/^) dWr and Mj is a square inte- 



i?5(s) :=^ 



tfe+i 



/3^^ 



^|:A.+ (/3^-)^a3n + i 



/s; 



fc,7V 



7.^'^ 



d\ 



+ z^^An + 2l3^'^z^'^j^'^d\ (r, Xf ) dr 



Integrating between s and t^+i and taking expectation we have 



-E 



/3; 



k,N 



Au{s,X^) 



-E 



/3jf^fAn(t,^„<^ 



+ R5{S), 



with |i?5(s)| < C/i. 



12 



OMAR ABOURA 



3.6.6. The term (I)q{s) = Zs' 7s' Au(^s,X^) . Applying Ito's formula to the product of 
Zr' 7r' and (j3.13p . and Lemma [3.101 we obtain for r S [tk,tk+i] 

d 



d 



z-;^^-%'-v {r,X^ ) 

2 



^k,N k,N 



dt 



V + z^^7^^/3.''^5^; + iz^^ (7.''^)' A^ + 



^k,N 



+ 



k,N 



(r - tk)v + z^^r/^^(r - tkh^'^'dv + 



k,N 



k.N ' 



r]';^"dv\ [r,X';)dr + dM, 



(3.19) 



where dMr- 



k,N 



k,N 
It' 



dv + Zr' rjr' {r — tk)v + 7r' r]r' v>[r, X^) dWr and Mr is 

a square integrable martingale. Using equation (j3.19p with v = Au, integrating between 
s and ifc+i and taking expectation give us 



-E 



-E 






+ R6(S) 



with |i?6(s)| < C/i. 



3.6.7. The term (J)t{s) = |/3s' 



k,N 



Is 



d'^u [s,X^^ . Using Lemma 13.101 and equation 



p.l7p . Ito's formula give us for v of class C 



1,2 



d 



fir 



k,N 
r 



ir 



^^f) 



A 



k,N 
r 



7^^ 



2^ 
dr 



u + 



A 



fc.AT 



.k,N 



' c>^; + ^/3,^'^ 



7^^ 



At; 
(3.20) 



+2/3^^7'-^^''^^ + /3''^ 



w 



|r-rfc|% + 2/3,^'^ 



,fc,Ar 



'^^^(r-r,)a. + .^^(7^^)^ 



5u 



+27^V'^^.''^(r - r,)t;} (r,X,^) dr 

z^^t; + /3^^ (7^^)' 9t; + 2/3^^7^^r7,^'^(r - r^).; I (r, Xf) dWr. 



+ 



k,N 



Using this equation with v = -^d^u, integrating between s and ifc+i and taking expectation 
we have 



1 



E 



/3; 



k,N 



,k,N 



Is 



' q3 



U \S 



,^f) 



1 



E 



A 



k,N 
tfe+i 



k.N 
7tfc+i 



5'M*'^+i'^4V 



+ i?7(s) 



with |i?7(s)| < C/i. 



3.7. Upper estimate of J^ {t). We upper estimate the error 4'i{s) 
one of the nine terms in the right hand side of (|3.12p 



i{tk) where ^i is 



3.7.1. The term </>i(s) 



k,N 



dt 



Au {s,Xf). Using (|3.17p with v = ^An, integrating 



between t^ and s, taking expectation and using the fact that 7^ ' = a {X[[) we have 



E 



,k,N 



2 d 



^An(.,Xf) 



with 



i?i(s) =^ 



dt 



7^^ 



E 



krai'|An(t„Xi^) 



+ iii(s), 



2^ 

Qj.2 



Au + {2^^.'"^z'/'^ + 



V^.^"" 



1 i2i t? A 



+ {/3^^ + 2r?,^ 



ifc)} 



Ir 






7^^ 






(r,Xf)dr. 



Corollary 13.151 implies that |-Ri(s)| < Ch. 
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fc,7V 



3.7.2. The term 4>2{s) = Ps' 

able Z, we have E ( Zfi^ 

between tk and s and taking expectation we have 

2 



■^k,N 



d^u (^s,X^^. For an J-'s-measurable random vari- 
E (zb (xl[^]y Using (1^:20]) with v = d^u, integrating 



E ^/3,^'^ 
where 

Ms) ■■= E 



% 



k,N 



d\{s,Xf) 



E 



b(X,^]\a{X,^J\^d\{t,,Xil) +R,is), 



tk 



{{2t 



k,N k,N ak,N , ak,N 



+ /3^^ 



2 d 



r/^^ 



7^^ 



1 



or 2 



r-t,|V27^V'^z^^(r-t.)}a='u 

4 



7.^'^ 



a^n 



{ 



A 



fc,Af 
r 



k,N k,N^ 



+ 2P^'''rj';^'\r-tk)+7rzr} 



7^^ 



a^n 



}(-, 



X,^) dr. 



Corollarv 13.151 imphes that |-R2('5)| < Ch. 



3.7.3. T/ie term 03(s) 
deduce 



fc.AT 



7^ 



d'^u (s, X^) . Using Lemma 13.101 and Ito's formula we 



d 



,k,N 



It 



7^^ 



{47^^zf'^ + 6 



r/^^ 



tfc|^}dr + 4 7^^M ^/.^'^^(r-ifc)^!^,. 



Using this equation and (J3.13P with v = 2^ " ^^i^l applying Ito formula, we have 



2 



7, 



fc.TV 



a4u(s,xf) 



2 



c7(X,^)Pa4n(t,,X,^) +i23(s), 



where Rz{s) < C/i by Corollarv 13.151 



3.7.4. The term, 4>i{s) = 27s' Zg' Au(,s,X^). Using (j3.19|) with v = 2/S.u we have 

= E 27^ J zt^Au (ti.,Xl^) +Ra(s). and Corollarv [5TT3] implies 



^ 



27s' Zs' Au(s,A^ 



|i?4(s)| < Ch. 



3.7.5. T/ie term (f)5{s) := R^is) := |s — tfel 
Using Corollarv 13. 15^ we have |-R5(s)| < Ch. 



k,N 
rjs' 



Au{s,X^)+2{s-tk) ir Vs'^d-^u{s,Xf). 



k,N , 



3.7.6. The term 4>fi{s) = ^ (a^Au) (s, Xf ) . Using (fXTSl) with v = ^ (a'^Au) , integrating 
between t^ and s and taking expectation, we have 



-E 



|(.^A.)(.,Xf) 



-E 



|(a^Au)(t„X,^)' 



+ ^6(s). 



with |^6(s)| < Ch by Corollary EUl 



3.7.7. The term 4>j{s) = /3^^a (a^Au) (s,Xf). Using (f3Ji]) with v = d{a'^Au), inte- 
grating between tk and s, taking expectation we have 



-E 



ok,N 



P^'^^d(a^An)ls,X, 



N-] 



-E[b{x[l) d [a' An) {tk,X^J]+Rr{s), 



with |^7(s)j < Ch by Corollary EUl 
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kM 



3.7.8. The term (i>s{s) = ^ "fs 

integrating between i^ and s, and finally taking expectation we have 

2 



1e 

2 



7: 



k,N 



A{a'Au){s,X, 



N\ 



A {a^Au) (s,Xf ). Using (IHTTll with v = ^Aia^Au), 
I expectation we have 

<T{OfA(<r=A,.)((,,Ol+fi8{»), 



2 



with |^8(s)| < Ch by Corollary ElSl 



3.8. Proof Theorem 12.11 (i). The identity (j3.18p and the upper estimate in section 3.6 
and 3.7 imply that 

Ef {X^) - Ef (Xt) = Y,E r^' I r^' i^{tk+i)ds + i f j^{tu)ds] dt + R 



fe=0 



N-l 



N-1 



l/.2^^if(t.+l) + i/.2 5;i?J,^(t.)+ii 



(3.21) 



where 



R 



N~l 7 

EE 

k=0 j=l 



k=0 

tk+l rt-k + i 



fc=0 



tk 



N-l 



Rj{s)dsdt+ ^ ^ 



*fe+i ft 



fc=0 j=l -"^fe 



Rj{s)dsdt. 



tk 



jk,N 



Hence |i?| < Ch^. Note that /J^;!; = b ix{l^] . Using ([33]) and ([33]) we deduce that 



k,N 



< = - i^ll) iS.b') (x/r^,) and 7£t: = - (^iT) [l + MS.6') (x/^^ J] = a (X,^) 5. (<^) . 



Therefore, we deduce that 



^(ifc+i) =^ (6an) (tfe+i, X,^^,) + [60 (69u)] (t.+i, X,^^,) + ^a' W) [^^A (65^)] (i.+i, X,^^, 
- "6|5.] (i.+i,<,) - [b'Au] (t.-,i,<,) -a^«) [6'5^An] (t._i,<, 

-rHK)mds{t,^„x!i^^). 

Similary, 7^^' = o" {X{^). So we have 



d 



+ 2ESnh' [X^\ a'Au {tk,X['J - E- {a^Au) (tfc,^,^) 



- Eb (X,^,,) d {a' An) {t,,Xf^) - \Ea'A [a' An) {t,,Xf^) . 
Notice that h and a do not depend upon t; hence after simplification we have 

(ifc+i) =bd{bdu) (tfc+i,Xi^^,) - b^Au (tfc+i,Xi^,,) + \cy^ {Xl[) {Slb"du) (tfc+i,Xi^^,) , 

(3.22) 



aN 



Eg{t,) =Eb [Xll^;) a'd\ {t,,x!l) + \Ea'd\ {t,,X,^J - Eb (x,^^^) d {a' An) (t.,X,^) 
- ^Ea^A {a^Au) {t^, X^^) + 2Eb'Sh (xH) a^Au (4, X,^) . (3.23) 



Corollary 13.151 implies the existence of a constant C, such that for all A; = 0, . . . , X — 1: 

\E{i^{tk+i)+j^{t,))\<C. 
Using this bound with (|3.2ip proves the first part of Theorem 12. 1[ 
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3.9. Proof Theorem 12.11 (ii). We at first prove the fohowing lemma, which upper esti- 
mates the error in the approximation of an integral by a Riemann sum. 

Lemma 3.18. Let v and w in C^'°°([0, T] x R). Then there exists a constant C inde- 
pendent of h such that 



hY^Ev (ife+i, X,^^ J w {tk,X^J -E I vw{t, Xt)dt 
fc=o •'^ 



<Ch. 



Proof. Using ()3.13p multiply by w{tk,X^) and taking expected value, we deduce for v G 
Ci'2, Ev (tk+i,Xl') w {tk, Xl'J = Evw (tfc, X,^) + Ak, where 



Ak:=Ew{tk,Xll) 






k,N 

It 



N\ 



Av} (t,Xf}dt. 



This yields 

7V-1 



7V-1 „x ^-1 

h^Ev (tfc+i, X,^^^) w {tk,Xl[) -E vw{t, Xt)dt = Y, {hAk + HBu + Cu). 

k=0 -^O fc=0 



where 



Bk :=E{vw) {tk,Xl'J - E{vw) (tk,Xt,) 



fe+i 



Ck ■.=hE{vw) {tk,Xt,) - E / {vw){t,Xt)dt. 

Jtk 

Using the Cauchy-Schwarz inequality, the fact that -^v, dv and Au have polynomial grow 
so that Corollary 13.151 can be applied, we deduce 



\AkV<E 



\^{^k,X^^)\' 



E 



tk 



*fe+l ( f) , -r 1 

I "^ , nk,N o , ^ 

^^ + A dv+- 



It 



k,N 



Av \ {t, X^) dt 



<ChE 



<Ch^ 



tk + l 



tk 



g-^V+f^, dv+- 



k,N 

It 



^v J> (t, Xt 



N\ 



dt 



Hence, \Ak\ < Ch which implies /iX^o<fc<Af-i l^'tl — ^^■ 

Since {vw){tk, ■) is in C^, we use Theorem l2.1l (i). changing T by tfc, which yields |i?fc| < Ch 

and then /iX]o<fc<Af-i l-^^l — ^^' Finally, Ito's formula implies 



C,=E 



-k+l 



{{vw){tk,Xt,)-{vw){t,Xt)}dt 



ftk+i ft ( Q I ) 

= -E \ jri'^w) + bd{vw) + -a^A{vw) \ {s, Xs)dsdt. 

Jtk Jtk l^* 2 J 

Once more the polynomial growth imposed on u, w and their partial derivatives implies 
that |Cfc| < Ch"^ and then X]o<fc<Af-i l^^l — ^^- This concludes the proof. D 

Now we introduce the function tpif^^ : [0, T] x R — )• R defined by 

^.^(t, x) ■.=hd{bdu){t, x) - -b^Au{t, x) + -a^Slb"du{t, x) + -ba^d^u{t, x) (3.24) 

+ la'^d\{t,x) + -b'Sh(T^Au{t,x) - hd{a^Au){t,x) - -a^A{a^Au){t,x) 
8 2 4 8 
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<Ch. 



(3.25) 



Using the expression of i^ in (|3.22p (resp. jj^ in (I3.23P ) and the previous lemma, we 
deduce 

-h Y, EiUtk+i) + -hY,Ej^{tk) - / Ei,,h{t,Xt)dt 

fc=0 fc=0 ° 

Using the definitions of f/'j and ipih given in (j2.2p and (j3.24p respectively, we have 
ijih{t, x) - tPiit, x) =j {a^Slb"du + ba^d'\ + 2b'Sh(J^Au - a^A{bdu)} {t, x) 

=^a^ {Si - 1) b"du{t, x) + h' {Sh - 1) a^Au{t, x). 

Since {Sh - 1) (x) = j^{x) and \Sh{x) + 1| < C7 for /i G (0, h*), we have 1(5^ - 1) (x)| + 
I (S*^ — l) (x) I < Ch, where as usually C does not depend on N and h. This yields 

rT 

E {^ih{t, Xt) - Mt, Xt)} dt < Ch. 

This last equation with (|3.2ip and (|3.25p concludes the proof. 

Acknowledgments: The author wishes to thank Annie Millet for many helpful com- 
ments. 
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